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Abstract 

The opposite states of the r polarization resulting from the charged Higgs 
boson and the W boson decays can be exploited to enhance the H ± signal 
in the inclusive 1-prong hadronic decay channel of r. We suggest practical 
methods of sharpening up the H ± signature in the top quark decay at LHC 
using this idea. As a result one can carry on the charged Higgs boson search 
to within ~ 20GeV of the parent top quark mass over the full parameter 
space of the MSSM. 
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1 INTRODUCTION 



A direct top quark signal has been recently observed at the Tevatron collider 
[1] with 

m t ~ 175 GeV, (1) 

which also agrees with the indirect estimate of top quark mass from LEP 
[2]. One expects a couple of dozens of clearly identifiable top quark events 
at the end of the current Tevatron run, which would go up to a few hun- 
dred following the upgradation of its luminosity via the main injector. The 
corresponding number of identifiable top quark events at LHC is expected 
to be of the order of a million per year - i.e. similar to the rate of Z boson 
events at LEP. Thus the LHC is expected to serve as a top quark factory, 
which will enable us to make a detailed study of its decay and in particular 
to search for new particles in top quark decay. There has been a good deal 
of recent interest in the search for one such new particle, for which the top 
quark decay provides by far the best discovery limit - i.e. the charged Higgs 
boson H ± of the supersymmetric standard model [3]. 

There have been several exploratory works on H ± search in the top quark 
decay at Tevatron and LHC energies [4-7]. They are based on one of the two 
distictive properties of H ± vis a vis the W ± boson - (i) the preferential H ± 
decay into the rv channel relative to ev or \iv [4,5], and (ii) the opposite 
states of r polarization resulting from H ± and W ± decays [6,7]. In a recent 
work [8] we have suggested methods of sharpening up the H ± signature in 
top quark decay by combining these two properties and applied them to 
H ± search at Tevatron upgrade. Even with the best signature, however, 
the prospect of search at Tevatron upgrade was seen to be limited to 
a small part of the parameter space. In the present work we shall analyse 
the prospect of H^ 1 search in top quark decay at LHC using these ideas. We 
shall see below that in this case one gets a viable signature over practically 
the full parameter space of coupling. Moreover with a supplementary 
constraint on the accompanying hadronic jets the signature remains viable 
over most of the kinematically allowed range of H ± mass. 
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2 CHARGED HIGGS SIGNAL IN TOP QUARK 
DECAY 



We shall concentrate on the charged Higgs boson of the minimal supersym- 
metric standard model (MSSM). Its couplings to fermions are given by 



H + < cot (3 Vijm Ui Uidj L + tan/3 Vijm dj Uid jR 



V2m 



w 



+ tan/3 mii.Vjtj R > + H.c. (2) 



where V%j are the Kobayashi-Maskawa (KM) matrix elements and tan/3 is 
the ratio of the vacuum expectation values of the two Higgs doublets. The 
QCD corrections are taken into account in the leading log approximation by 
substituting the quark mass parameters by their running masses evaluated 
at the H ± mass scale [5]. Perturbative limits on the tbH Yukawa couplings 
of Eq. (2), along with the constraints from the low energy processes like 
b — > S7 and Bd — Bd mixing, imply the limits [9] 



0.4 < tan/3 < 120. 



(3) 



In the most predictive form of MSSM, characterised by a common SUSY 
breaking mass term at the grand unification point, one gets stronger limits 
[10] 

1 < tan/3 < m t /m b . (4) 

Such a lower bound also follows from requiring the perturbative limit on 
the tbH Yukawa coupling to hold upto the unification point [11]. However, 
we shall consider the full range (3) of the phenomenologically allowed tan (3 
parameter. 

In the diagonal KM matrix approximation, one gets the decay widths 
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H^TV 



(m t cot (3 + m b tan (3)(m t + m b — m H ) — Am t m b (6) 

9 2 m H 2. 2 n , 7 N 

tan p (7) 



327rm 2 y 

T^ cs - = 3 2 ^f ( m c cot 2 /3 + m 2 tan 2 /?) . (8) 

From these one can construct the relevant branching fractions 

Bt^bH = ^t^bu/ (Tt^bH + F t ^bw) (9) 

(10) 

It is the product of these two branching fractions that controls the size of 
the observable charged Higgs signal. The t — > bH branching fraction has a 
pronounced dip at 

tan (3 = (m t /m b ) 2 ~ 6, (11) 

where (6) has a minimum. Although this is partly compensated by a large 
value of the H — > tv branching fraction, which is ~ 1 for tan/3 > 2, the 
product still has a significant dip at (11). Consequently the predicted charged 
Higgs signal will be very weak around this point as we shall see below. 

The basic process of interest is tt pair production through gluon-gluon 
(or quark-antiquark) fusion followed by their decay into charged Higgs or W 
boson channels, i.e. 

gg ^bb(H + H-,H ± W T ,W + W-). (12) 

The r decay of one or both the charged bosons leads to a single r, tt or £t 
final state, where £ denotes e and \i. Each of these final states is accompanied 
by several hadronic jets and a large missing-i?T (transverse energy) due to 
the neutrinos. 

A brief discussion of the r-identification at hadron colliders is in order 
here. Starting with a missing- trigger, the UAl, UA2 and CDF exper- 
iments have been able to identify r as a narrow jet in its hadronic decay 
mode [12,13]. In particular the CDF experiment has used the narrow jet cut 
to reduce the QCD jet background by an order of magnitude while retaining 
most of the hadronic r events. Moreover, since the hadronic r and QCD jet 
events dominantly populate the 1-prong and multi-prong channels respec- 
tively, the prong distribution of the narrow jets can be used to distinguish 



4 



the two. In particular restricting to 1-prong jets reduces the QCD back- 
ground by another order of magnitude with very little loss to the hadronic 
r signal. In this way the CDF group [13] has been able to reduce the QCD 
background to a few tens of events in a data sample of integrated luminosity 
~ 4p6 _1 , which could be subtracted out by extrapolation from higher prong 
channels. Consequently they were able to identify the W — > rv events and 
test W universality as well as put some modest constraints on top and H ± 
masses from the level of the residual rv events. In the present case, how- 
ever, one would be looking for a few tens of hadronic r events in a data 
sample of over 1000 times higher integrated luminosity and 10 times higher 
QCD jet cross-section. So the QCD jet background cannot be controlled by 
the above method, even with b identification. Therefore one cannot use the 
single r channel for the charged Higgs search and even the rr channel can 
be at best marginal. The best charged Higgs signature is provided by the 
It channel. The largest background comes from W — > tv accompanied by 
QCD jets, which can be easily controlled by the above mentioned jet angle 
and multiplicity cuts. Besides the hard isolated lepton I provides a more 
robust trigger than the missing-E^, particularly at the LHC. Therefore we 
shall concentrate mainly on the It channel. 

The £r and rr channels correspond to the leptonic decay of both the 
charged bosons in (12), i.e. 
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(13) 



where L and R stand for left and right handed helicities of r. By convention, 

a ± - a ± 

P r = P T - = -P T+ , P T ±= * L . (14) 

cr_± + a + 

For the It channel of our interest the signal and the background come from 
the HW and WW terms respectively. They correspond to exactly opposite 
states of r polarization, i.e. 

P T H = +1, Pf = -1. (15) 
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Consequently the use of the tau polarization effect for enhancing the signal 
to background ratio is particularly simple in this case as we shall see below. 
It may be noted here that the rr channel has a better signal to background 
ratio because of the HH contribution as well as the enhancement of WH 
relative to WW by a combinatorial factor of 2 [5]. On the other hand the 
polarization distinction is less simple. While both the r's in the background 
have negative polarization one or both of them have positive polarization in 
the signal. Nonetheless the method of enhancing the signal to background 
ratio by the r polarization effect discussed below can be extended to this 
channel, provided one can identify the rr events from the QCD background. 



3 TAU POLARIZATION EFFECT 

We shall concentrate on the 1-prong hadronic decay channel of r, which is 
best suited for r identification. It accounts for 80% of hadronic r decays and 
50% of overall r decays. The main contributors to the 1-prong hadronic r 
decay are [2] 

i^v T (12.5%) (16) 
p ± u T -> t^ttV (24%) (17) 
afu -> tt^ttV (7.5%) (18) 

where the branching fractions for the n and p channels include the small con- 
tributions from the K and K* channels respectively, since they have identical 
polarization effects. Note that only half the a± decay channel contributes to 
the 1-prong configuration. The masses and widths of p and a\ are [2] 

m p {Y p ) = 770(150) MeV, m ai (r oi ) = 1260(400) MeV. (19) 

One sees that the three decay processes (16,17,18) account for about 90% of 
the 1-prong hadronic decay of r. Thus the inclusion of r polarization effect 
in these processes will account for its effect in the inclusive 1-prong hadronic 
decay channel to a good approximation. 

The formalism relating r polarization to the momentum distribution of 
its decay particles in (16,17,18) has been widely discussed in the literature 
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[6,7,8,14,15]. We shall only discuss the main formulae relevant for our anal- 
ysis. A more detailed account can be found in a recent paper by Bullock, 
Hagiwara and Martin [7], which we shall closely follow. For r decay into n 
or a vector meson (p, ai), one has 

: i(l + P r cos#) (20) 
2 



1 


dT w 




dcosO 


1 


dT vL 




dcos9 


i 


dT vT 




dcosO 



m 2 T + 2ml 
ml 



ml + 2ml 



;i + P r cos#) (21) 
;i-P r cos^) (22) 



where v stands for the vector meson and L, T denote its longitudinal and 
transverse polarization states. The angle 9 measures the direction of the 
meson in the r rest frame relative to the r line of flight, which defines its 
polarization axis. It is related to the fraction x of the r energy-momentum 
carried by the meson in the laboratory frame, i.e. 

2x — 1 — m? ,,/ml , 

costf = — 2 *: vl 2 T . (23) 

1 - mi Jmi 

Here we have made the collinear approximation m T p T , where all the decay 
products emerge along the r line of flight in the laboratory frame. 

The above distribution (20-22) can be simply understood in terms of 
angular momentum conservation. For t^, l s — > v L n~ , v^ =0 it favours forward 
(backward) emission of n or longitudinal vector meson, while it is the other 
way round for transverse vector meson emission t^ £ x — > vl^\=-\- Thus 
the 7r ± s coming from H ± and W ± decays peak at x — 1 and respectively 
and (x n )H = 2(x n )w = 2/3. Although the clear separation between the 
signal and the background peaks disappears after convolution with the r 
momentum, the relative size of the average 7r momenta remains unaffected, 
i.e. 

(pZ)h ^ 2{pl) w for m H ~m w . (24) 

Thus the r polarization effect (20) is reflected in a significantly harder ^ 
momentum distribution for the charged Higgs signal compared to the W 
boson background. The same is true for the longitudinal vector mesons; but 
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the presence of the transverse component dilutes the polarization effect in 
the vector meson momentum distribution by a factor (see eqs. 21,22) 

ml — 2ml 



V 



m\ + 2ml 



(25) 



Consequently the effect of r polarization is reduced by a factor of ~ 1/2 in p 
momentum distribution and practically washed out in the case of a±. Thus 
the inclusive 1-prong r jet resulting from (16-18) is expected to be harder 
for the ^ signal compared to the W boson background; but the presence of 
the transverse p and a\ contributions makes the size of this difference rather 
modest. We shall see below that it is possible to suppress the transverse p 
and a\ contributions and enhance the difference between the signal and the 
background in the 1-prong hadronic r channel even without identifying the 
individual mesonic contributions to this channel. 

The key feature of vector meson decay, relevant for the above purpose, 
is the correlation between its state of polarization and the energy sharing 
among the decay pions. The transverse p and a\ decays favour even sharing of 
energy among the decay pions, while the longitudinal p and a\ decays favour 
asymmetric configurations where the charged pion carries either very little 
or most of the vector meson energy. It is easy to derive this quantitatively 
for the p decay. But a\ decay is more involved. One can show from general 
considerations that the ayr(L) 37r decay favours the plane of the 3 pions in 
the ai rest frame being normal to (coincident with) the cti line of flight [15]. 
This agrees qualitatively with the above pattern of energy sharing. But one 
has to assume a dynamical model for a\ decay to get a more quantitative 
result. We shall follow the model of Kuhn and Santamaria, based on the 
chiral limit (conserved axial- vector current approximation), which provides a 
good description of the a\ — > 3n data [16]. One gets very similar pion energy 
distributions from the alternative model of Isgur et al [17], as shown in [7]. 
A detailed account of the p and a\ decay formalisms can be found in [7,8] 
along with the prescriptions for incorporating the finite p and a\ widths. We 
shall only summarise the results below. 

Fig. 1 shows the p and a\ decay distributions in the energy-momentum 
fraction x', carried by the charged pion. The distributions are shown for 
both longitudinal and transverse polarization states of the vector mesons. 
The transverse p and a\ distributions are clearly seen to vanish at the end 
points and peak in the middle, reflecting equipartition of energy- momentum 
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among the decay pions. In contrast the longitudinal p distribution shows 
pronounced peaks near the end points x' — and 1, and the longitudinal 
cii at the former point. Note also that the direct pionic decay of r (16) can 
be formally looked upon as a delta function contribution at x' — 1 in this 
figure. Thus one can suppress the unwanted and cl\t contributions while 
retaining the n and at least good fractions of pi and by restricting to 
the regions x' ~ and 1. We shall see below how this can be achieved even 
without identifying the individual mesonic contributions in r decay. 



4 STRATEGY, RESULTS AND DISCUSSION 

As mentioned earlier, we are interested in the inclusive 1-prong hadronic 
decay of r, which is dominated by the ir"* 1 , /r* 1 and af contributions (16,17,18). 
It results in a thin 1-prong hadronic jet (r-jet) consisting of a charged pion 
along with 0, 1 or 2 7r°'s respectively. Since all the pions emerge in a collinear 
configuration, one can neither measure their invariant mass nor the number 
of 7r°'s. Thus it is not possible to identify the three mesonic states. But it is 
possible to measure the energy of the charged track and the accompanying 
neutral energy separately, either by measuring the momentum of the former 
in the tracking chamber and the total energy deposit in the electromagnetic 
and hadronic calorimeters serrounding it or from the showering profiles in 
these electromagnetic and hadronic calorimeters [18]. Thus one has to devise 
a strategy to suppress the transverse vector meson contributions using these 
two pieces of information. We shall consider two such strategies below. In 
either case a rapidity and a transverse energy cut of 

\r]\ < 3 and E T > 20 GeV (26) 

will be applied on the r-jet as well as the tagging lepton £, where E T includes 
the neutral contribution to the former [18]. We shall also apply isolation 
cuts to ensure that there are no hadronic jets within a cone of radius AR = 
{Arf + A0 2 ) 1 / 2 = 0.4 around the r-jet and the tagging lepton. 

The first strategy is to impose a calorimetric isolation cut on the r-jet, 
which requires the neutral E T accompanying the charged track within a cone 
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of AR = 0.2 to be less than SGeVfi i.e. 

E T C = E T < 5 GeV. (27) 

As we see from Fig. 1, this cut eliminates the pr and ayr contributions along 
with the x' ~ peaks of pl and a%L- It retains only the tt and the x' ~ 1 
peak of the contribution. This results in a substantially harder signal 
cross-section relative to the background, but at the cost of a factor of ~ 2 
drop in the signal size. 

The second strategy is to plot the r-jet events satisfying (26) as a function 

of 

AE T = \Eft-E% (28) 

i.e. the difference between the Et of the charged track and the accompanying 
neutral Et instead of their sum. It is clear from Fig. 1 that the even 
sharing of the transverse p and a\ energies among the decay pions imply 
a significantly softer AEt distribution for pt and ayr relative to p^ and 
an- This results in a substantially harder signal cross-section relative to 
the background when plotted against AEt instead of Et- Moreover this is 
achieved at no cost to the signal size unlike the previous case. 

In comparing the two methods one notes that the first is easier to imple- 
ment and besides it helps to suppress the level of QCD jet background as 
well. On the other hand the second method has the advantage of a factor of 
~ 2 larger cross-section. While studying the H ± signature at the Tevatron 
upgrade in [8], we had found the second method more viable in view of the 
limited size of the ti signal there. Since the size of this signal will be very 
large at the LHC, however, both the methods will be equally viable as we 
shall see below. 

We have estimated if ± signal and the background cross-sections at 
the LHC energy of 

v/i = 14 TeV (29) 

using a parton level Monte Carlo program with the recent structure functions 
of [19]. In stead of the differential cross-section in Et (or AEt), we have 
plotted the corresponding integrated cross-sections 

a(E T ) = / -TErdEr (30) 

2 Depending on the energy resolution of the calorimeters, this can be increased upto 
lOGeV without affecting the results significantly. 



10 



against the cut-off value of Et (or AEt). Fig. 2 shows these cross-sections 
for 

tan/3 = 3 and m H = 120, 140 GeV (31) 

(a) for the raw signal, (b) using the calorimetric isolation cut (27) and (c) 
using AE T instead of E T . 

There is a clear hardening of the signal curves relative to the background 
as one goes from Fig. 2a to 2b or 2c. One could of course see a similar 
hardening in the corresponding differential cross-sections. But the present 
plots are better suited to compare the relative merits of the three methods in 
extracting the signal from the background. For this purpose the cut-off value 
of E T (AE T ) is to be so chosen that one gets a viable signal to background 
ratio, i.e. 

i^T ± signal/W ± background > 1. (32) 

The resulting signal cross-section, as given by the cross-over point between 
the signal and background curves, is a reasonable criterion for the merit of 
the method. One clearly sees that this point is reached at a much larger 
value of the cut-off in Fig. 2a, corresponding to a far greater sacrifice to the 
signal size, than in 2b or 2c. The resulting signal cross-sections for itlh = 120 
and 140 GeV are ~ 20 fb and less than 1 fb in Fig. 2a, going up to ~ 300 
and 50 fb respectively in Fig. 2b and about double these values in Fig. 2c. 
It is remarkable that a simple calorimetric isolation cut (27) can enhance 
the signal-background separation so much and increase the effective signal 
cross-section by over an order of magnitude. Of course the signal cross- 
section obtained via the AEt distribution is still larger by a factor of ~ 2, 
as anticipated earlier. 

To probe the H ± discovery limits at LHC using the three methods, we 
have estimted the corresponding signal cross-sections, satisfying (32), as func- 
tions of tan p. These are shown in Fig. 3a,b,c for a set of H ± masses, 

m H = 80, 100, 120, 140, 150, 160 GeV. (33) 

There is a clear dip at tan/5 ~ 6 as anticipated in (11). One sees a gap in 
the tan f3 space around this region where the raw signal of Fig. 3a is clearly 
not viable. But the improved signals obtained via the calorimetric isolation 
cut (Fig. 3b) or the AE T distribution (Fig. 3c) remain > 100(1) fb for 
m H = 120(140) GeV throughout the tan (3 space. It may be noted here that 
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one expects an integrated luminosity of 

/ Ldt~ 100 fb' 1 



(34) 



from the high luminosity run of the LHC. For a signal size of ~ 1 fb satisfying 
(32), it corresponds to signal and W ± background events of ~ 100 each. 
Since the latter can be predicted from the number of tt events in the dilepton 
(£ + £~) channel using W universality, this will correspond to a ~ 10cr signal for 
the if ± boson. Thus a signal size of ~ 1 fb in Fig. 3 will constitute a viable 
signal for the high luminosity run of LHC. This means that the improved 
signatures for H ± boson search at LHC are viable upto m H = 140 GeV over 
the full tan (3 space. 

It may appear from Fig. 3 that for extreme values of tan (5 ( ^ 1 or 
^ 50), where the raw signal of 3a is already large, there is no advantage 
in going to 3b or 3c. It should be noted however that in this case the r 
polarization effect can serve as an independent test for the if ± signal. The 
hardening (softening) of the signal (background) cross-section of Fig. 2 or 
equivalently the corresponding differential cross-section [8], as one imposes 
the calorimetric isolation cut or goes to the AE? variable, is a distinctive 
prediction of the r polarization effect that holds independent of tan/5. 

Finally, one can push the viability of these two signatures to still higher 
values of mu with a suitable cut on the accompanying hadronic jets. For this 
purpose one exploits the fact that for m# ~ m t the accompanying 6-jet in 
the t — > bH{W) — > brv decay is necessarily soft for the H signal but not the 
W background [5]. Thus the WW background can be suppressed without 
sacrificing the HW signal by imposing a kinematic cut of 



on all but one of the accompanying hadronic jets. Of course in the process 
one would be sacrificing both the signal and background events which are 
accompanied by a hard QCD jet, which implies a reduction of the signal 
size without affecting the signal to background ratio. But we do not expect 
this reduction factor to be very large. Moreover if there is reasonable b 
identification efficiency at the LHC, then one can by pass this problem by 
imposing this cut on one of the identified 6-jets. 

Fig. 4a,b,c shows the tan (3 distribution of the signal cross-sections sat- 
isfying (32), after this kinematic cut. The cross-sections are shown only for 



E 3 T et < 30 GeV 



(35) 
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the high values of mu (140,150 and 160 GeV), for which the cut is rele- 
vant. There is again a large gap in the tan/3 space where the raw signal is 
not viable (Fig. 4a). But the improved signals via the calorimetric isola- 
tion cut (Fig. 4b) or the AE T distribution (Fig. 4c) remain > 10(1) fb 
for mu — 140(150) GeV throughout the tan/3 parameter space. Thus they 
provide unambiguous signatures for boson search upto tuh = 140 and 
150 GeV at the low and high luminosity runs of LHC, corresponding to in- 
tegrated luminosities of 10 and 100 fb~ l respectively. In fact for the high 
luminosity run the signatures remain viable over the full tan (3 space upto a 
if ± mass of 155 GeV - i.e. within 20 GeV of the parent top quark mass. 

In summary, we have explored the prospect of charged Higgs boson search 
in top quark decay at the LHC, taking advantage of the opposite states of r 
polarization resulting from the H ± and W ± decays. We have concentrated on 
the most promising channel for H ± search - i.e. the It channel, followed by 
the inclusive decay of r into a 1-prong hadronic jet. Two practical methods 
of sharpening up the signature, using the r polarization effect, have 
been studied. The resulting signatures are shown to be viable over the full 
parameter space of tan/3 upto mu = 140 GeV. Moreover with a kinematic 
cut on the accompanying hadronic jets, one can stretch their viability upto 
m H = 150 — 155 GeV - i.e. within 20 GeV of the parent top quark mass. 

The work of SR is partially supported by a project (DO No. SR/SY/P- 
08/92) of the Department of Science and Technology, Government of India. 
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Figure Captions 



Fig. 1. Distributions of the — > n^n and af — > tt^tt ^ decay widths in the 
energy fraction carried by the charged pion, shown separately for the 
transverse and longitudinal states of p and a\ polarization. 

Fig. 2. The integrated 1-prong hadronic r-jet cross-sections are plotted against 
cut-off values of the jet Ej- in (a) without and (b) with the isolation 
cut. They are plotted against the cutoff-value of AE? of the jet in 
(c). The H ± signal (W ± background) contributions are shown as solid 
(dashed) lines for m H = 120 GeV and dot-dashed (dotted) lines for 
m H = 140 GeV. We take ^=U TeV and tan (3 = 3. 

Fig. 3. The signal cross-sections of Fig. 2(a,b,c) satisfying a signal to back- 
ground ratio > 1 are shown as functions of tan (3 for m H = 80, 100, 120, 140, 150, 160 
GeV by solid, dashed, dot-dashed, double dot-dashed, dotted and 
multidot-dashed lines respectively. 

Fig. 4. The signal cross-sections are shown as in Fig. 3, but with an addi- 
tional cut of E^ et < 30 GeV on the second hardest accompanying 
jet, for m H = 140, 150, 160 GeV by solid, dashed and dot-dashed lines 
respectively. 
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